Grid Services for Efficient Decentralized Indexation and Query Execution on Distributed Data Warehouses
نویسندگان
چکیده
Online analysis of large volumes of data consists an important part of today's business and scientific applications. Storing structured data in data warehouses following a multidimensional storage model provides efficient and reliable access to it. Distributed systems have become the first choice to cope with the increasing volume and complexity of data warehouses. In order keep up with this trend, large quantities of interconnected computing and storage resources are now being integrated into computing grids. Adapting data warehouse concepts to grids however requires decentralized management of their traditionally centralized storage and query execution model. The grid services architecture we present in this paper therefore uses a unique data identification to implement grid-wide data localization based on local indexes in combination with a catalog service. These structures integrate information on both materialized and computable data for cost-optimized distributed query execution.
منابع مشابه
A Framework for Efficient Query Answering on Semantically Heterogeneous Grids
With the rapid growth of grid computing, more and more data are generated and stored across the grid. To fully utilize the data, efficient data search and query answering mechanism is becoming a very important issue. However, the sheer amount of data and their heterogeneity nature pose challenges that current technology cannot cope with efficiently. In this paper, we propose an efficient query ...
متن کاملGrid Data Integration Based on Schema Mapping
Data integration is the flexible and managed federation, analysis, and processing of data from different distributed sources. Data integration is a key issue for exploiting the availability of large, heterogeneous, distributed and highly dynamic data volumes on Grids. This paper presents a framework for integrating heterogeneous XML data sources distributed among the nodes of a Grid. We present...
متن کاملQuery Optimization Architecture for Data Grid Environment
Query optimization in data integration systems over large scale network, faces the challenges of dealing with autonomous, heterogeneous and distributed data sources, dynamic execution environment and changing user requirements. In this paper we introduce system architecture for query optimization. The latter consists of several important phases. We introduce also a cost model to calculate the c...
متن کاملService-Based Distributed Querying on the Grid
Service-based approaches (such as Web Services and the Open Grid Services Architecture) have gained considerable attention recently for supporting distributed application development in e-business and e-science. The emergence of a service-oriented view of hardware and software resources raises the question as to how database management systems and technologies can best be deployed or adapted fo...
متن کاملEnabling platforms for high - performance computational grids oriented scalable virtual organizations Workpackage 6 Knowledge Services for Intensive Data Analysis and Intelligent Query Answering WP
The activities included in this work package share the common objective of building middleware services for knowledge intensive applications and processes. Specifically, the services we intend to design and implement concern two main topics: • information extraction and knowledge discovery from structured sources (databases or data warehouses) and semi-structured ones (such as web pages or XML ...
متن کامل